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DETAILED ACTION 



1. 



This is a Non-Final rejection in response to RCE filed on 02-13-2007. 



2. 



Claims 1-11, and 13-69 are pending. 



3. 



Effective filing date is 03-30-2004. 



Continued Examination Under 37 CFR LI 14 



4. A request for continued examination under 37 CFR 1.114, including the fee set forth in 
37 CFR 1.17(e), was filed in this application after final rejection. Since this application is 
eligible for continued examination under 37 CFR 1.1 14, and the fee set forth in 37 CFR 1.17(e) 
has been timely paid, the finality of the previous Office action has been withdrawn pursuant to 
37 CFR 1.114. Applicant's submission filed on 2-13-2007 has been entered. 



The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all obviousness 
rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 



5-1; Claims 1-11, 13-15, 19, 21-29, 31, 33-42, 44-59, 61-66, and 68-69 are rejected under 
35 U.S.C. 103(a) as being unpatentable by O'Neal et al. US 200401 13935A1 filed May 30, 
2003 (hereinafter O'Neal), in view of Nirell et al. US007086032B2 filed Feb. 20, 2003 
(hereinafter Nirell). 



Claim Rejections - 35 USC § 103 
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Regarding independent claims 1, O'Neal teaches: 

a method in a computer system for creating a composite electronic 
representation including presentation material information, the method 
comprising: 

(See O'Neal para 6, teaching electronic presentation includes annotation to presentation material. 

Also, see O'Neal para 7, teaching a first video input signal; and having a second video 
input signal; and a third display screen coupled with the programmable computer and having a 
third video input signal. The presentation system also includes a presentation control software 
application that is stored in a second memory accessible by the programmable computer wherein 
the programmable computer is configured to execute the presentation control application to 
provide an interface, displayed on the third display screen, by which each of the plurality of 
slides is dispatched for display to either one of the first or second display screens. The third 
display screen includes a multi-windowed display interface that simultaneously. Using the 
broadest reasonable interpretation, Examiner reads the claimed a composite electronic 
representation as equivalent to a first video input signal; and having a second video input 
signal; and a third display screen coupled with the programmable computer and having a third 
video input signal for electronic presentation includes annotation to presentation material as 
taught by O'Neal. 

receiving an electronic presentation of a document with presentation 
material. 

Also, see O'Neal para 7, teaching electronic presentation includes annotation to 
presentation material. 



Application/Control Number: 10/813,901 Page 4 

Art Unit: 2176 

extracting a feature from the electronic presentation of the document, the 
feature corresponding to a portion of the presentation material. 

Also, see O'Neal para 8, teaching electronic presentation displays a slide, from among 
the plurality of slides. 

comparing the feature to the recorded information to determine information 
in the recorded information corresponding to the feature, the recorded 
information including information recorded during a presentation of the 
presentation material, 
Also, see O'Neal para 127-129, teaching the presentation control system automatically 
locates recently annotates slides and forwarding on for updating. 

whereby at least a portion of the recorded information corresponds to a 
feature portion of the presentation material; 
Also, see O'Neal para 8, teaching the first slide among the slides is automatically 
presented in a preview window, in step 506, so that the presenter can see what the next slide is 
and decide how it can best be displayed. At this point, the presenter might determine that the 
slide should be annotated, in step 508, before being displayed. Using broadest reasonable 
interpretation, Examiner equates the claimed a portion of the recorded as equivalent to the first 
slide among the slides as taught by O'Neal; and because the current specification discloses, "the 
portions of recorded information... may includes, pages of a presentation, video, audio, etc." see 
Applicant invention specification page 20 para 53. 

and storing the composite electronic representation for access by the user of 
another user accessing the composite electronic document. 
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Also, see O'Neal para 6, teaching electronic presentation displays a slide, from among 
the plurality of slides. Wherein presentation materials can easily be directed to any one of the 
display screens, and any annotations can be saved for future use or simply deleted.) 

In addition, O'Neal does not explicitly teach, but Nirell teaches: 

automatically inserting a user selectable object into the electronic 
representation of the document to create the composite electronic 
representation the user selectable object being placed in a position associated 
with the extracted feature. 
(See Nirell col 6 lines 5-15, teaching the automatic capture mode the current screen (or specified 
portion thereof) displayed by video monitor 128 is captured each time a user changes the focus 
of an active application program 156 or otherwise presses a key of the keyboard 120. 

Also, see Nirell col. 5, lines 30-40, teaching an imported movie (e.g., an AVI file), an 
imported or inserted image, a blank frame, a colored frame, imported presentations of various 
formats (e.g., PowerPoint presentations), and other files containing graphics information. 

Also, see Nirell fig. 5 and also col. 7, lines 30-40, teaching within Frame Edit View, a 
user may modify the current mouse pointer position by clicking and dragging to a desired 
location within the frame 504. 
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500 




FIG, 5 

It would have been obvious to one of ordinary skill in the art at the time of the invention 
to modify O'Neal to include automatically inserting a user selectable object into the electronic 
representation of the document to create the composite electronic representation the user 
selectable object being placed in a position associated with the extracted feature as taught by 
Nirell. One of ordinary skill in the art would have been motivated to modify this combination 
because O'Neal and Nirell, because they are from the same field of endeavor of electronic 
presentation includes annotation to presentation material and allows a presenter to effectively 
and dynamically present material that can easily be modified and augmented according to each 
environment in which the presentation is made (See O'Neal para 5). 
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and allowing the user to access the determined composite information 
relating to the information in the recorded information corresponding to the 
extracted feature, and storing the composite electronic representation for 
access by the user or another user of the computer system accessing the 
composite electronic document. 

creating a composite electronic presentation of the document includes the 
determined additional information and storing the composite electronic 
representation for access by a user of the computer system. 

Also, see O'Neal para 6, teaching electronic presentation displays a slide, from among 
the plurality of slides. Wherein presentation materials can easily be directed to any one of the 
display screens, and any annotations can be saved for future use or simply deleted. 

determining additional information relating to the information in the 
recorded information corresponding to the feature extracted from the 
electronic representation. 
Also, see O'Neal para 127-129, teaching the presentation control system automatically 
locates recently annotates slides and forwarding on for updating. 
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Regarding Independent claim 21, the rejection of claim 1 is fully incorporated. 
In addition, O'Neal teaches: 

determining composite information based on information in the recorded 
information that corresponding to the feature and the received electronic 
representation of the document. 

(See O'Neal para 6, teaching electronic presentation includes annotation to presentation 
material.) 



Regarding Independent claim 34, the rejection of claim 1 is fully incorporated. 

In addition, claim 34 is directed to a computer product to perform the method of 
claim 1, which cites above, and is similarly rejected under the same rationale (see claim 1 
rejection cites above, and also see O'Neal para 7). 

Regarding Independent claim 44, the rejection of claim 21 is fully incorporated. 

In addition, claim 44 is directed to a computer product to perform the method of 
claim 21, which cites above, and is similarly rejected under the same rationale (see claim 
21 rejection cites above, and also see O'Neal para 7). 

Regarding Independent claim 51, the rejection of claim 1 is fully incorporated. 

In addition, claim 51 is directed to a data processing system to perform the 
method of claim 1, which cites above, and is similarly rejected under the same rationale 
(see claim 1 rejection cites above, and also see O'Neal fig. 1 and para 7). 
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Regarding Independent claim 61, the rejection of claim 21 is fully incorporated. 

In addition, claim 61 is directed to a data processing system to perform the 
method of claim 21, which cites above, and is similarly rejected under the same rationale 
(see claim 21 rejection cites above, and also see O'Neal fig. 1 and para 7). 

Regarding Independent claim 68, the rejection of claim 1 is fully incorporated. 

In addition, claim 68 is directed to a system to perform the method of claim 1, 
which cites above, and is similarly rejected under the same rationale (see claim 1 
rejection cites above, and also see O'Neal fig. 1 and para 7). 

Regarding Independent claim 69, the rejection of claim 21 is fully incorporated. 

In addition, claim 69 is directed to a system to perform the method of claim 1, 
which cites above, and is similarly rejected under the same rationale (see claim 21 
rejection cites above, and also see O'Neal fig. 1 and para 7). 

Regarding claims 2, 22, 35, 45, 52, and 62, O'Neal teaches: 

determining associating information for the recorded information 
that corresponds to the extracted feature. 

(See O'Neal para 6, teaching electronic presentation includes annotation to presentation material. 

Also, see O'Neal para 127-129, teaching the presentation control system automatically 
locates recently annotates slides and forwarding on for updating.) 
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Regarding claims 3, 23, 46 and 63, O'Neal teaches: 

wherein the association information comprises time information and 
source information for recorded information. 

(See O'Neal para 6, teaching electronic presentation includes annotation to presentation material. 

Also, see O'Neal para 127-129, teaching the presentation control system automatically 
locates recently annotates slides and forwarding on for updating. 

Also, see O'Neal para 9, teaching a timeline.) 

Regarding claims 4, 36, and 53, O'Neal teaches: 

associating the association information with the determined additional 
information in the composite electronic representation. 

(See O'Neal para 6, teaching electronic presentation includes annotation to presentation material. 

Also, see O'Neal para 127-129, teaching the presentation control system automatically 
locates recently annotates slides and forwarding on for updating.) 

Regarding claims 5, 24, 37, 47, 54 and 64, O'Neal teaches: 

receiving a selection to the determined additional information in the 
composite electronic representation and using the association information for 
the additional information to access the recorded information. 

(See O'Neal para 6, teaching electronic presentation includes annotation to presentation material. 

Also, see O'Neal para 127-129, teaching the presentation control system automatically 
locates recently annotates slides and forwarding on for updating.) 
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Regarding claims 6, 25, 38 and 55, O'Neal teaches: 

accessing the recorded information using the determined additional 
information. 

(See O'Neal para 6, teaching electronic presentation includes annotation to presentation material. 

Also, see O'Neal para 7, teaching a plurality of presentation slides stored in a first 
memory accessible by a programmable computer. 

Also, see O'Neal para 127-129, teaching the presentation control system automatically 
locates recently annotates slides and forwarding on for updating.) 

Regarding claims 7, and 26, O'Neal teaches: 

displaying the accessed recorded information. 

(See O'Neal para 6, teaching electronic presentation includes annotation to presentation material. 

Also, see O'Neal para 7, teaching a plurality of presentation slides stored in a first 
memory accessible by a programmable computer.) 

Regarding claims 8, and 27, O'Neal teaches: 

playing the accessed information. 

(See O'Neal fig. 1, and para 29, teaching the video data displayed on the interface monitor 104 is 
provided by video output 1 16b of the computer 106.) 
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Regarding claims 9, 29, 39, 49, 56 and 66, O'Neal teaches: 

performing at least one of emailing, printing, storing, and copying the 
created composite electronic representation. 

(See O'Neal para 7, teaching a first video input signal; and having a second video input signal; 
and a third display screen coupled with the programmable computer and having a third video 
input signal The presentation system also includes a presentation control software application 
that is stored in a second memory accessible by the programmable computer wherein the 
programmable computer is configured to execute the presentation control application to provide 
an interface, displayed on the third display screen, by which each of the plurality of slides is 
dispatched for display to either one of the first or second display screens. The third display 
screen includes a multi-windowed display interface that simultaneously. Using the broadest 
reasonable interpretation, Examiner reads the claimed a composite electronic representation as 
equivalent to a first video input signal; and having a second video input signal; and a third 
display screen coupled with the programmable computer and having a third video input signal 
for electronic presentation includes annotation to presentation material as taught by O'Neal.) 

Regarding claims 10, 28, 40, 48, 57 and 65, O'Neal teaches: 

determining metadata using the recorded information that 
corresponds to the feature, wherein the composite electronic representation 
includes the metadata. 

(See O'Neal para 6, teaching electronic presentation includes annotation associates to 
presentation material. 
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Also, see O'Neal para 127-129, teaching the presentation control system automatically 
locates recently annotates slides and forwarding on for updating. Using the broadest reasonable 
interpretation, Examiner reads the claimed metadata as equivalent to electronic presentation 
includes annotation associates to presentation material al as taught by O'Neal.) 

Regarding claims 11, 41 and 58, O'Neal teaches: 

wherein the received electronic representation of the paper document 
includes notes taken by a user, wherein the created composite electronic 
representation includes the notes taken by the user. 

(See O'Neal para 6, teaching electronic presentation includes annotation associates to 
presentation material. 

Also, see O'Neal para 127-129, teaching the presentation control system automatically 
locates recently annotates slides and forwarding on for updating.) 

Regarding claim 13, O'Neal teaches: 

determining a document that includes the recorded information using 
the extracted feature. 

(See O'Neal para 8, teaching electronic presentation displays a slide, from among the plurality of 
slides. 

Also, see O'Neal para 127-129, teaching the presentation control system automatically 
locates recently annotates slides and forwarding on for updating.) 
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Regarding claim 14, O'Neal teaches: 

determining a portion of the document that includes the information 
corresponding to the feature. 

(See O'Neal para 8, teaching electronic presentation displays a slide, from among the plurality of 
slides. 

Also, see O'Neal para 127-129, teathing the presentation control system automatically 
locates recently annotates slides and forwarding on for updating.) 

Regarding claims 15, 31, 42, 50 and 59, O'Neal teaches: 

an identifier to a location in the recorded information, wherein the 
information in the recorded information corresponding to the feature is 
determined using the identifier. 

(See O'Neal para 71, teaching a "favorites" list displayed in window 610. This list can be named 
something meaningful such as "favorites.fVt" and located in the default directory 
"D:.backslash.courses". Other file names and locations could also be used. Using the broadest 
reasonable interpretation, Examiner reads the claimed an identifier to a location in the 
recorded information as equivalent to a "favorites" list displayed in window 610. This list can 
be named something meaningful such as "favorites.fVt" and located in the default directory 
"D:.backslash.courses". Other file names and locations could also be used as taught by O'Neal.) 
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Regarding claims 19, and 33, O'Neal teaches: 

wherein receiving the electronic representation comprises receiving 
the electronic representation in response to an input from a user indicating 
that the composite electronic representation should be created. 

(See O'Neal fig. 14 para 123, teaching FIG. 14 depicts how the windows change once a portion 
1404 of the slide 1402 has been selected with the tool 1306. In particular, the left side display 
screen is no longer blank but displays a "zoomed-in M portion of the slide as shown in the left- 
hand window 1406. The display of the slide in window 1402 also changes to include some visual 
cues, such as shading, that highlight the selected portion 1404. The window 1204 continues to 
show the next slide in the presentation.) 

5-2. Claims 16-18, 20, 30, 32, 43, 60 and 67 are rejected under 35 U.S.C. 103(a) as being 
unpatentable by O'Neal et al. US 200401 13935A1 filed May 30, 2003 (hereinafter O'Neal), 
in view of Nirell et al. US007086032B2 filed Feb. 20, 2003 (hereinafter Nirell), further in 
view of Copperman et al. US006665490B2 issues Dec. 16, 2003 (hereinafter Copperman).. 

Regarding claims 16 and 32, O'Neal and Nirell do not explicitly teach, but Copperman teaches: 
the identifier comprises at least one of a barcode and signature 
information. 

(See Copperman col 12 5 line 47, teaching the bar codes. 
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It would have been obvious to one of ordinary skill in the art at the time of the invention 
to modify O'Neal and Nirell to include the identifier comprises at least one of a barcode and 
signature information as taught by Copperman. One of ordinary skill in the art would have been 
motivated to modify this combination because O'Neal, Nirell, and Copperman because they are 
from the same field of endeavor of electronic presentation includes annotation to presentation 
material and allows a presenter to effectively and dynamically present material that can easily be 
modified and augmented according to each environment in which the presentation is made (See 
O'Neal para 5), and allows users to access particular points for play back what was said at the 
exact time that the original notes were taken (see Copperman col. 1 lines 35-45). 

Regarding claims 17-18, O'Neal and Nirell do not explicitly teach, but Copperman teaches: 

receiving the electronic representation comprises receiving a scan of 
the document, the document being a paper document, wherein receiving the 
electronic representation comprises determining an electronic image of the 
document, the document being a paper document. 

(See Copperman col 3, lines 10-15, teaching user makes a note on paper with a combined 

pen/camera or with pen or pencil. If notes are made with pen or pencil, they can either be 

subsequently scanned or can be written under a camera. 

Also, see Copperman col 13, lines 10-21, teaching images of annotations are stored in the 

table with annotation IDs and timestamps. This allows a composite image substantially identical 

to the paper that the notes were written on, to be constructed and displayed for the user on a 

screen. 
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It would have been obvious to one of ordinary skill in the art at the time of the invention 
to modify O'Neal and Nirell to include receiving the electronic representation comprises 
receiving a scan of the document, the document being a paper document, wherein receiving the 
electronic representation comprises determining an electronic image of the document, the 
document being a paper document as taught by Copperman. One of ordinary skill in the art 
would have been motivated to modify this combination because O'Neal, Nirell, and Copperman 
because they are from the same field of endeavor of electronic presentation includes annotation 
to presentation material and allows a presenter to effectively and dynamically present material 
that can easily be modified and augmented according to each environment in which the 
presentation is made (See O'Neal para 5), and allows users to access particular points for play 
back what was said at the exact time that the original notes were taken (see Copperman col. 1 
lines 35-45). 

Regarding claims 20, 30, 43, 60 and 67, O'Neal and Nirell do not explicitly teach, but 
Copperman teaches: 

the document comprises a paper document. 

(See Copperman col 3, -lines 10-15, teaching user makes a note on paper with a combined 
pen/camera or with pen or pencil. If notes are made with pen or pencil, they can either be 
subsequently scanned or can be written under a camera. 

It would have been obvious to one of ordinary skill in the art at the time of the invention 
to modify O'Neal and Nirell to include receiving the electronic representation comprises 
receiving a scan of the document, the document being a paper document, as taught by 
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Copperman. One of ordinary skill in the art would have been motivated to modify this 
combination because O'Neal, Nirell, and Copperman because they are from the same field of 
endeavor of electronic presentation includes annotation to presentation material and allows a 
presenter to effectively and dynamically present material that can easily be modified and 
augmented according to each environment in which the presentation is made (See O'Neal para 
5), and allows users to access particular points for play back what was said at the exact time that 
the original notes were taken (see Copperman col. 1 lines 35-45). 

6. It is noted that any citations to specific, pages, columns, lines, or figures in the prior art 
references and any interpretation of the references should not be considered to be limiting in any 
way. A reference is relevant for all it contains and may be relied upon for all that it would have 
reasonably suggested to one having ordinary skill in the art. See, MPEP 2123. 

Response to Argument 

7. Applicant's Remarks filed on 2-13-2007 with respect to claim 1-1 1, and 13-69 have been 
considered but are moot in view of the new ground(s) of rejection. This office action is a Non- 
Final Rejection in order to give the applicant sufficient opportunity to response to the new line of 
rejection. 
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Conclusion 

8. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Tran A. Quoc whose telephone number is 571-272-8664. The 
examiner can normally be reached on 9AM - 5PM EST. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Heather R. Herndon can be reached on 571-272-4136. The fax phone number for the 
organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the Patent 
Application Information Retrieval (PAIR) system. Status information for published applications 
may be obtained from either Private PAIR or Public PAIR. Status information for unpublished 
applications is available through Private PAIR only. For more information about the PAIR 
system, see http://pair-direct.uspto.gov. Should you have questions on access to the Private PAIR 
system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). If you would 
like assistance from a USPTO Customer Service Representative or access to the automated 
information system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 

Quoc A. Tran 
Patent Examiner 
Tech Center 2176 
April 24, 2007 




